DOCUMENT RESUME 



ED 264 251 



TM 850 524 



PUB TYPE 



EDRS PRICE 
DESCRIPTORS 




AUTHOR Danzig, Arnold B. 

TITLE Student Outcomes on the Arizon? Teacher Proficiency 

Examination. 
PUB DATE 31 Mar 85 

NOTE 16p,; Paper presented at the Annual Meeting of the 

American Educational Research Association (69th, 
Chicago, IL, March 31-April 4, 1985). 
Speeches/Conference Papers (150) — Reports - 
Research/Technical (143) 

MFOl/PCOl Plus Postage, 
*Basic 
Educati 
Competency 

Education; State Programs; State Standards; *Teacher 
Evaluation; *Teacher Qualifications; Test Results 
♦Arizona Teacher Proficiency Examination 

This paper examined some of the issues surrounding 
the Arizona Teacher Proficiency Examination (ATPE) , including the 
rationale for teacher testing, the Arizona approach to testing, and 
selected student outcomes. Arizona moved from Legislative directive 
in April 1980, to the implementation of the Arizona Teacher 
Proficiency Examination in June 1981. The Basic Skills component of 
the ATPE was a four hour, 150 question test made up of three parts: 
reading, grammar, and mathematics. A passing grade was 80 percent on 
each subtest. In April 1984, legislation was signed requiring 
students entering teacher education programs to pass the Basic Skills 
exam. Failure rates were particularly high among minorities, with the 
overall minority failure rate averaging 69 percent. Reasons for 
testing at the entry level were discussed, and exam scores were 
compared with other measures of student ability. Alternatives were 
offered to basic skills testing. (LMO) 



IDENTIFIERS 



ABSTRACT 



* 'Reproductions supplied by EDRS are the best that can be made 

* from the original document. 

************ 



in STUDENT OUTCOMES ON THE AMZONA TEACHER 

OJ PROFICIENCY EXAMINATION 

OJ 

o 



BY 

ARNOLD DANZIG 
Assistant Professor 
Center for Excellence in Education 
Northern Arizona University 



DEPARTMENT OF EDUCATION 
NATIONA'.. INSTITUTE OF EDUCATION 
EDUCATlONAt. RESOURCES INFORMATION 

CENTER (ERIC) 
fTThu docunncnt has b««n r«produc*d ai 
rec«iv«d from th« person of oroanuaton 
ongmating it, 
i I M»oof Chang*) hav« b««n mada to impfov* 
rtproductton quality. 



• Poiniiolv<eworopM\K>ni«tat»djntHs(Jocu- 
mtnt do not necw»anly reprasant official NIE 
pojjton Of policy 



"PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



^ Paper presented at the Annual Meeting 

of the American Educational 
O Research Association, Chicago 

^ March 31, 1985 

ERIC o 



T, .-."^n^^^l^""^ Suess it ain't never right to do bad now and figure to do good later on." 
Herbie Bookbinder in CITY BOY by Herman Wouk. 

The Arizona Teacher Proficiency Examination (ATPE) is a simple and attractive 
solution to a complex problem. And, simple answers have a way of catching on and 
leading us astray. Unfortunately, there are no easy solutions. 

This paper examines some of the issues surrounding the Arizona Teacher 
Proficiency Examination, including the rationale for teacher testing, the Arizona 
approach to testing, and selected student outcomes. It is hoped that a better 
understanding of some of the causes and effects of basic skills testing for prospective 
teachers will result. 

What is t he Arizona Teacher Proficiency Examination (ATPE)? 

"To qualify for either a basic or standard teaching certificate, or equivalent 
certificate later adopted by the State Board of Education, an applicant, in addition to 
other requirements, shall pass a reading, grammar and mathematics proficiency 
examination as administered by the State Board of Education" (Arizona Revised 
Statutes 15-533, 1980). 

Arizona moved from legislative directive in April 1980, to the implementation of 
the Arizona Teacher Proficiency Examination (ATPE) in June 1981.' To meet the legal 
implementation date set by the Legislature, the Common Examination of the National 
Teachers Examination was used on an interim basis. A task force set up by the Arizona 
Department of Education then evaluated previously prepared test items in reading, 
grammar and mathematics from a test bank developed by the Los Angeles County 
Superintendent's Office and determined the. content as appropriate for use as the Basic 
Skills component of the ATPE. 

The Basic Skills component is a hour, 150 question test made up of three parts: 
reading, grammar and mathematics. A passing grade is 80 percent on each subtest. In 
April 198'f, legislation was signed which requires students entering teacher education 
programs pass the Basic Skills exam. 
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To qualify for entrance into any teacher training program in the 
college of education of a university under the jurisdiction of the 
Arizona Board of Regents • • • a person, in addition to other 
requirements, must pass each component of the reading, 
grammar and mathematics proficiency examination (Senate 
Engrossed Copy of Arizona House Bill 2156, 

As mentioned above, each section of the Exam, rather than the total score, must be 
passed at the 80 percent level. 

Although not the focus of this paper, there is also a Professional Knowledge 
component of the ATPE. Questions taken from six content areas make up this 
component and fifty percent of questions must be answered correctly to achieve a 
passing score. At the present time, 89 percent of the takers of the test pass it. The 
Professional Knowledge component is a requirement of Arizona teacher certification 
and has nothing to do with college or program entry. For purposes of clarity, reference 
to the ATPE will refer only to the Basic Skills component of the exam. 
Why Proficiency Testing for Prospective Teachers ? 

The question listed above is made up of three parts: (1) Why test teachers? (2) 

Why test basic skills proficiency? (3) Why focus on prospective teachers? Rubinstein, 

McDonough and Allan (1982) argue that teacher testing grew out of the general 

dissatisfaction with the outcomes of public education and the accompanying demands 

for accountability. 

The focus broadened from an examination of the curriculum and 
student outcomes to include an appraisal of the agents of 
instruction: teachers themselves (p. 11). 

Weaver (1979) argues that fewer job openings in the 1970's along with growth 

opportunities and salaries in other fields, particularly for women, led to a deteriorated 

teacher applicant pool. Hathaway (1980) and Ivie (1982) show education majors scoring 

at or near the bottom on the Scholastic Aptitude Test and the Graduate Record 

Examination. The growth of teacher testing is documented by the fact that between 
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1977 and 1981, sixteen states enacted legislation or state board of education policy 
which either changed or initiated teacher testing (Rubinstein et aU , 1982). 

Wny test for basic skills proficiency? Jaeger (1982) discusses minimal 
competency testing and locates such programs as political rather than educational in 
origin* 

Minimal competency testing programs constitute political 
responses to perceived public demand . . • Such programs reflect 
the blind faith of sta'ie legislatures and state boards of education 
to mandate— through law, regulation, or administrative action— 
some minimal level of educational succe. s (pp. 226-227). 

As states adopted minimal competency testing programs for students, it was not 
difficult to extend the movement to teachers. Public concern over student basic skill 
proficiency was also accompanied by public concern over teacher competency witness 
the 1980 Time Magazine cover story "Help! Teacher Can't Teach*" Rubinstein et al. 
(1982) name ten states having basic skills tests prior to certification* 
Why test prospective teachers? 

Pressure to test prospective as opposed to incumbent teachers has come from 
teachers' organizations. Both the .National Education Association (NEA) and the 
American Federation of Teachers (AFT) oppose the testing of employed teachers 
(Pearson, 1981). The other question raised is whether to test prospective teachers prior 
to program entry or as an exit examination. In Arizona, the Basic Skills component of 
the ATPE has recently been changed from an exit to an entry level exam. The pressure 
for this change came from the universities and colleges of education themselves. They 
argued that exam scores reflect basic skill attainment achieved at earlier levels of a 
student's education (Danzig, 198*). With an entry level exam, the locus of blame would 
be on the student, public schools and undergraduate studies rather than on the 
examination or college of education program, and embarrassment over the fact that 
some graduates (in some cases more than half) couldn't pass a basic skills test. 



would be eliminated. Rubinstein elal. (1982) name ten states, excluding Arizona, which 
require an exam prior to entry into teacher education. 
Effects at the State Level 

Critics of minimal competency testing have pointed to high minority failure as 
one limitation of the approach (Jaeger, 1982; Siegel, 1983). Table I supports this view 
and the reader should note an overall minority failure rate of 69 percent {SiS/StS). 

(Insert Table I here) 

Particularly at risk are Native Americans with a 79.9 percent fair.«re rate (2*6/308). 
Regardless, the Exam leads to a reduced number of qualified applicants for teacher 
certification in Arizona, 
Effects at the Cnlle p;e T.PV<>I 

As mentioned earlier, pressure to use the ATPE as an entry level examination 
came in part, from the colleges of education. Embarrassed over the fact that their 
graduates could not pass a basic skills proficiency exam, they argued for early 
identification and possible remediation. "Why let a student attend four years of teacher 
education only to be unable to achieve certification?" With an entry level exam, one 
hundred percent of graduates would be eligible for certification. 

Table II gives ATPE results during the first testing as an entry level exam. The 
reader should note the high percentage of failure, particularly minority failure. The 
reader should also note that approximately one third of students fail to take the Exam a 
second time and that W percent (35 out of 81) of retakes fail for a second time. An 
applicant pool of 20* is reduced to 113 eligible applicants to teacher education. 
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Table I 



Results on the Basic Skills Component of the 
Arizona Teacher Proficiency Exam 
By Ethnic Group 



Ethnic GrouD 


Pass 


Fail 


Total 


White 


272^^ (73.0%) 


1006 (27.0%) 


3730 


Black 


*3 (31.2) 


95 (58.8) 


138 


Hispanic 


1*8 (39.5) 


227 (60.5) 


375 


Native American 


62 (20.1) 


2*6 (79.9) 


308 


Asian 


10 (37.0) 


17 (63.0) 


27 




2987 (65.2%) 


1591 (3*.8%) 


*578 (100%) 



Data is from test period July 1, 1983 - July 31, 198*. 
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Table II 



Results on Basic Skills Component of ATPE 
Used for Admissions to Teacher Education 



First Time Takers (10/18/8*) 

Ethnic Group Pass Fail Total 

'^hite 6* (39.5%) 98(60.5%) 162(100%) 

Black 1 (33.3) 2 (66.7) 3 

Hispanic 1(7.7) 12(92.3) 13 

Native American 1(6.3) _15(93.7) ig 

67 (3*.5) 127 (65.5) 19* 

Retakes (11/15/8*) 

Ethnic Groug Pass Fail Total 

White 36(63.2%) 21(36.8%) 57(100%) 

Black 1 (50) 1 (50) 2 

Hispanic 6 (66.7) 3 (33.3). 9 

Native American _3(23.1) JO (76.9) 13 

*6 (56.8) 35 (*3.2) 81 



Data taken from College of Education at Northern Arizona University. 
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And by program entry requirements, a student is only permitted to take the Exam three 
times* 

Score acceptability on a locally normal test of basic skills to 
include reading, mathematics, and grammar. Student will be 
permitted to take the examination a maximum of three times 
(Northern Arizona University, 1983-1985 General Catalogue, p. 
192). ^ ^ 

It is ironic that the most recent legislation not only changed the ATPE from an 
exit to an entry level Exam, it also raised the passing requirement for 80 percent total 
score to 80 percent sub-test score. Table III indicates the results. 

(Insert Table III here) 

Whereas 30 out of 75 students achieved passing scores (*0 percent) under the old law, 
this will be reduced to 22 out of 75- (29.3 percent) passing scores, a reduction in the 
total percent of passing scores of approximately 11 percent. The result is a drastically 
reduced applicant pool based on results of 150 multiple choice questions. 
Effects at the District Level 

There is potential for bias even after the Exam has been passed. In the Fall of 
1982, questionnaires were sent to school districts in Arizona asking superintendents to 
respond to. two questions concerning the ATPE: (1) Is the Arizona Teacher Profiency 
Examination Bade Skills section used as a hiring tool in your district? (2) Do you 
request applicants to reveal their Basic Skills raw scores? Twenty-three (1* percent) 
districts responded affirmatively to the first question as did (six percent) to the second. 
While these numbers are fairly small, it is possible that the raw scores will become a 
way for districts to prioritize applicants, further penaUzing low scoring but successful 
students. 

Exam Scores and Other iMeasures of Student Ability 

It was of interest to know what relationship might exist between college grade 
point average and basic skills proficiency. During October 1981, during the validation 



Table III 



CHANGES RESULTING FROM NEW LEGISLATION REQUIRING 80 PERCENT PASS 
FOR EACH SECTION OF THE ARIZONA TEACHER 
PROFICIENCY EXAMINATION* 



Prior to Legislation After New Legislation (same data) 



Pass 


Fail 


Total 


Pass 


Fail 


Total 


26 


19 


*5 Whites 


20 


25 


1^5 Whites 


1 


6 


7 Hispanics 


0 


7 


7 Hispanics 


3 


20 


23 Native 


2 


21 


23 Native 



Americans Americans 



*The data reflect test scores during January - March, 198*. 
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period of the Exam, Ikl students were tested. The mean GPA was 1.667 with a range 
from .5*5 to *.000. Table IV shows a high positive correlation between GPA and Exam 
scores. 



(Insert Table lY here) 



During March 1982, students taking the Exam were also asked to fill out a one- 
page questionnaire concerning past academic performance. Students were asked to 
evaluate their own ability in mathematics and English on a scale of 1 to 5 (A to F). 
Thirty students participated and it was of interest to know whether thes'* self- 
evaluations were associated with scores on the Exam. Table Y indicates a high positive 
correlation between student self-evaluation and Exam score. 



(insert Table Y here) 
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Students do seem to be able to evaluate their own proficiency in English and 
mathematics with some degree of accuracy. 

One other piece of information relates to student performance on the ACT 
Academic Tests. Using names from the September 1981 testing, ACT scores for thlrty- 
f; -e students were found and correlation coefficients computed. These results are 
presented in Table VI. 

(Insert Table YI here) 

Taken together, the evidence in Tables *-6 indicate that basic skills test scores 
are related to other measures of past and present academic performance. And, that the 
i( -ormation they reveal is not something unknown to students. 

H 



Table IV 



Pearson Product-Moment Correlations Between Student Grade 
Point Average and Admissions Exam Scores^ 



Math 


Vocabulary 


Reading 


SpellinK 


Usage 


.5236 


.6127 


.5795 


.5806 


.5920 


N=U1 


N=1*0 


N=l*l 


N=1'H 


N=1'H 


p <.001 


p <.001 


p<.001 


p<.001 


p<.001 



^The first version of the Exam used for admissions was made up of five sections, 190 
questions. This was later reduced to 150 questions in three sections. 
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Table Y 



Pearson Product-Moment Correlations Between Student 
Self-Evaluations and Exam Scores 





Math Subscore 


Reading Subscore 


Grammar Subscore 


Math Self- 








Evaluation 


.6617 


.5687 


A62Q 




. N=30 


N=30 


N=30 




p<.001 


p<.002 


p<.005 


English Self- 




Evaluation 


.*823 


.5753 


.^190 




N=30 


N=30 


N=30 




p <.003 


p<.001 


p<.02 
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Table VI 



Pearson Product-Moment Correlations Between 
ACT Scores and Admissions Exam Scores 



ACT ACADEMIC TESTS 

English Mathematics Social Studies Natural Science 

Usage Usage Reading Reading 



Math 


A370 


.5890 


.2593 


.1550 




N=35 


N=35 


N=35 


N=35 




p<.005 


p<.001 


p<.05 


P<.05 


Vocabulary 


.6580 


.6053 


.mi 


.?005 




N=3* 


N=3'^ 


N=3'^ 


N=3'^ 




p<.00i 


p< .001 


p<.001 


P<.05 


Reading 


.6289 


.5029 


.600^^ 


.3533 


Comprehension N=3't 


N=3'^ 


N=3'^ 


N=3'^ 




p<.00i 


p<.001 


p<.001 


p<.02 


Spelling 


.5062 


.2733 


.3000 


.2002 






N=3'^ 


N=3'^ 


N=3'^ 




p<.00i 


p<.05 


p<.0'^2 


p<.05 


Usage 


.5798 


.33 1^^ 


.2915 


.1881 






N=3'^ 


N=3'^ 


N=3'^ 




p<.00i 


p< .003 


p<.0'^7 


p<.05 


Total 


.7676 


.6096 


.5628 


.3537 




N=3«^ 


N=3'^ 


N=3'f 


N=3'^ 




p<.00i 


p<.001 


p<.001 


P<.02 
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An Alternative to Basic SKiils Testing 

As mentioned earlier in the paper, minimal competency .esting is a political 
rather than education response. The basic skills testing approach breaks down because 
test scores ignore the more difficult questions of motivation, desire, and suitability. 
Basic skills testing of prospective teachers eliminate candidates, particularly minority 
candidates. That is all it does. 

It "A^ould be more appropriate for prospective teachers to participate in an entry 
level course of study in which the decision of whether to become a teacher is the focus. 
"Do I have the requisite skills to be a teacher?" "Does the profession offer the kinds of 
rewards and satisfactions that I will need?" Sixteen weeks devoted to the decision to 
become a teacher, the skills required of the teacher, the rewards and challenges of the 
profession, seems a more logical way to limit the applicant pool Of this is what is 
necessary) than 150 multiple choice questions in reading, grammar and mathematics. 
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